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Abstract 

f— I In this paper we consider tests for nonlinear time series, which are motivated by the 



notion of serial dependence. The proposed tests are based on comparisons with the quantile 
spectral density, which can be considered as a quantile version of the usual spectral density 
function. The quantile spectral density 'measures' the sequential dependence structure of 
I— I a time scries, and is well defined under relatively weak mixing conditions. We propose an 

^ estimator for the quantile spectral density and derive its asympototic sampling properties. 

^ We use the quantile spectral density to construct a goodness of fit test for time series and 

lO explain how this test can also be used for comparing the sequential dependence structure 

^ of two time series. The asymptotic sampling properties of the test statistic is derived under 

^ the null and an alternative. Furthermore, a bootstrap procedure it proposed to obtain a 

^ finite sample approximation. The method is illustrated with simulations and some real data 

1-H examples. 

^> Key words and phrases: Bootstrap, goodness of fit tests, mixing, nonlinear time 

^ series, quantile spectral density. 

1 Introduction 



The analysis of most time series is based on a set of assumptions, which in practice need to be 
tested. This is usually done through a goodness of fit test. The majority of goodness of fit tests 
for time series are based on fitting the conjectured model to the data, estimating the residuals 
of the model and testing for lack of correlation, normally with a Ljung-Box type test (see for 
example, Anderson (1993) and Hong (1996)). Chen and Deo (2004) propose a test based on the 
spectral density, and Hallin and Puri (1992) propose robust tests based on ranks. If one restricts 
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the class of models to just linear time series models, then these tests can correctly identify the 
model. However, problems can arise, if one widens the class of models and allow for nonlinear 
time series. For example, if the time series were to satisfy an ARCH process, then it will be 
uncorrelated, but it is not independent. Furthermore, the squares will satisfy an autoregressive 
representation, with errors which are martingale differences. Therefore, correlation based test 
for nonlinear time series models may not identify the model. 

Neumann and Paparoditis (2008) propose a goodness of fit test for Markov time series models 
based on the one step ahead transition distribution. But this test is specifically for Markov 
models. An alternative approach is to generalise the notion of correlation to measuring the 
general dependence between pairs of random variables in a time series. This notion is usually 
called serial dependence, and can be traced dates back to Hoeffding (1948). Skaug and Tj0stheim 
(1993) and Hong (2000) use this definition to test for serial independence of a time series. Hong 
(1998) takes these notions further, and generahses the spectral density to sequential dependence. 
He does this by defining the generalised spectral density, which is the Fourier transform of the 
characteristic function of pair- wise dependent data. He uses this device in Hong (1998) and Hong 
and Lee (2003) to test for goodness of fit of a time series model, mainly through the analysis of 
the estimated residuals. However, sometimes the residuals cannot be or are not easy to estimate. 
For example, it is possible to estimate the residuals of an ARCH [Xt = Zfat), possible but 
difficult with a GARCH and usually impossible for many models of the type Xt — g{Xt-i, £<). 

In this paper, we use the notion of serial dependence to test for goodness of fit, but without 
estimating the residuals. In Section 2.1 we motivate our test by considering the Microsoft daily 
log return data and compare it with the GARCH(1, 1) model (one of the standard models for such 
data sets). We show that though the GARCH model seems to model well some of the stylised 
facts of this data, ie. the uncorrelatedness of the data and positive correlation in the absolute 
values, if one made a deeper analysis and compared the correlation of other transformations such 
as cov{I{Xt < x), I{Xt+T < y)) (where I denotes the indictator function), there is large difference 
between the data and GARCH model. This motivates us to define the quantile autocovariance 
function and the quantile spectral density. The quantile spectral density can be considered as a 
measure of serial dependence of a time series. In Sections 2.2 and 2.3 we propose a method for 
estimating the quantile spectral density, and use the quantile spectral density as the basis of a 
test which compares the quantile spectral density estimator with the spectral density estimator 
under the null hypothesis. The asymptotic sampling properties of the quantile spectral density 
estimator arc derived in Section 3.1. Recently there have been several articles defining and 
estimating the spectral density of sequential dependence. In particular, Li (2008), Hagemann 
(2011) and Dcttc, Hallin, Kley, and Volgushav (2011) define spectral density functions similar to 
the quantile spectral density, however these authors, estimate the periodogram and the quantile 
spectral density using Li methods. In contrast, our approach is motivated by the definition of 
the periodogram, this leads to an estimator of the quantile spectral density with an analytic 
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form, thus can easily be used in both goodness of fit and other tests. However, it is interesting, 
and rather surprising, to note that the Li estimator proposed in Dette et al. (2011) and our 
estimator of the quantile spectral density share similar asymptotic properties. In Section 3.2 we 
derive the asymptotic sampling properties of the test statistic. An advantage of our approach is 
that it can easily be extended to test other quantities, for example with a small adaption it can 
be used to test for equality of serial dependence of two time series, this is considered in Section 
4. In Section 5 we propose a bootstrap method for estimating the finite sampling distribution of 
the test statistic under the null. The proofs can be found in the Appendix and technical report. 



2 The quantile spectral density and the test statistic 
2.1 Motivation 

To motivate our approach, we analyze the Microsoft daily log returns (MSFT) between March 
1986 - June 2003, which we denote as {X^}. One argument for fitting GARCH types models to 
financial data is their ability to model the so called 'stylised facts' seen in such data sets. We 
now demonstrate why this is the case for the MSFT data (see Zivot (2009)). Using the maximim 
likehhood, the GARCH model which best fits the log differences of the MSFT is Xt = /J, + et, 
where = cr^Z^, = ao + Oie^.i + ba^_i {{Zf} are independent, identically distributed standard 
normal random variables), with // = 1.56 x 10~^, oq = 1.03 x 10~^, Oi = 0.06 and b — 0.925. 
In Figure 1 we give the sample autocorrelation plots of {Xf} and {l-'^tl}, together with the 
autocorrelation plots of the corresponding GARGH(1,1) model. Comparing the two plots, it 
appears that the GARGH(1, 1) captures the 'stylised facts' in the Microsoft data, such as the 
near zero autocorrelation of the observations and the persistant positive autocorrelations of the 
absolute log returns. However, if we want to check the suitabihty of the GARGH model for 
modelling the general pair- wise dependence structure, that is the joint distribution of {Xs,Xt) 
for all s and t (often called sequential dependence), then we need to look beyond the covariance 
of {Xf} and To make a more general comparison we transform the data into indicator 

variables {I{Xt < x)} and check the correlation structure of the indicator variables over various x. 
For example, define the multivariate vector time series = {I{Xt < qo.i),IiXt < qo.5),I{Xt < 
^o.g)), where denotes the estimated a-percentile of Xf. Plots of the cross-covariances of Y_^ and 
the corresponding GARGH model (with Gaussian innovations) arc given in Figure 2. In Figure 
2, there are clear differences in the dependence structure of the data and the GARGH model. 
The 10th, 50th and 90th percentiles correspond to large negative, zero and large positive values 
of Xt (big negative change, no change and large positive changes in the returns). In order to do 
the analysis, we will use the following observations. By using that cov(/(Xo < x), I{Xj. < y)) — 
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P{Xo <x,Xr<y)- P{Xo < x)P{Xr < y), for all x,yeRwe have 
cov(7(Xo < x), I{Xr < y)) = cov(7(Xo > x), 7(X, > y)) = -cov(7(Xo < x), 7(X, > y)). 



From Figure 2 we observe: 

• The ACF of I{Xt < go.5) of ths GARCH is zero. This is due to the symmetry of the 
GARCH process: given the event Xq < 0, we have equal chance > and < (ie. 
cov(7(Xo < 0),7(X^ < 0)) = -cov(7(Xo < 0),7(X^ > 0))). This means that cov(7(Xo < 
0),I{Xr < 0)) = 0. On the other hand, for the MSFT data we see that there is a clear 
positive correlation in the sample autocorrelation of {7(Xt < 0)}. One interpretation for 
this behaviour, is that a decrease in consecutive values, is likely to lead to future decreases. 

• The cross correlation cov(7(Xo < qo.i), I{-^r < Qo.g)), where {Xf} comes from a GARCH is 
symmetric, ie. cov(7(Xo < qo_i),I{Xr < go.9)) = cov(7(X'o < qo,i),I{X_r < qo.g))- On the 
other hand, the corresponding sample cross-correlations of the MSFT is not symmetric. 
Thus the GARCH process is time reversible, whereas it appears that the MSFT data may 
not be. 

The cross and autocovariances in Figure 2 are a graphical representation of the serial dependence 
structure of the time series. These plots suggest that for the MSFT data the GARCH model 
may not be the most appropriate model, especially if validity is based on modelling the serial 
dependence structure. In the sections below we will test this. 

2.2 The quantile spectral density function 

We now formalise the discussion above. Let us suppose that {Xt} is a strictly stationary time 
series. It is obvious that the cross covariance of the indicator functions {I{Xt < x),I{Xt < y)} 
is 



Cr{x, y) := cov(7(Xo < x), I{X, < y)) = P{Xo <x,Xr<y)- P{Xo < x)P{Xr < y). 



Skaug and Tj0stheim (1993) and Hong (2000) use a similar quantity to test for serial inde- 
pendence of a time series. We call Cr{-) the quantile covariance. If {Xt} is an a-mixing time 
series with mixing rate s > 1 (s is defined in Assumption 3.1, below) it can be shown that 



sup^ |cov(7(Xo < x), I{Xr < 2/))| < oo, thus for all x, y e M, it's Fourier transform 





r 
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is well defined. Since G{x,y;uj) can be considered as the cross-spectral density of {I{Xt < 
x),I{Xt < y)}, we call G{-) the quantile spectral density. 



2.2.1 Properties of the quantile spectral density 

The quantile spectral density carries all the information about the serial dependence structure 
of the time series. For example (i) if {Xt} is serially independent, then G does not depend on 
u and G{x,y;uj) — p{x,y) (ii) if for all r, the distribution function of {Xo,Xr) is identical to 
the distribution function of {XQ,X_r), then G{-) will be real and (iii) for any given x and y, 
G gives information about any periodicities that may exists at a given threshold. In addition, 
G{-) captures the covariance structure of any transformation of {Xt} . For example, consider 
the transformation {h{Xt)}, then it is straightforward to show that the spectral density of the 
time series {h{Xt)} is 



Of course, G{x,y;u) only captures the serial dependency, and may miss higher order structure. 
Only in the case that {Xt} is Markovian, does G{x, y; cu) capture the entire joint distribution of 



Remark 2.1 The quantile spectral density is closely related to the generalised spectral den- 
sity introduced in Hong (1998). He defines the generalised spectral density as h{x,y;uj) — 
cov{exp{ixXQ),exp{iyXr)) exp{iru) . Essentially, this is the Fourier transform of the charac- 
teristic function ofpairwise distributions minus their marginals, therefore the relationship between 
the quantile spectral density and the generalised spectral density is analogous to that between the 
distribution function and the characteristic function of a random variable. Hong (1998, 2003) 
uses the generalised spectral density as a tool in various tests goodness of fit tests, which are 
mainly based on the residual. On the other hand, the goodness of fit test that we propose, is 
based on checking for similarity between the estimated quantile spectral density and the proposed 
spectral density. 

Remark 2.2 (The Copula spectral density) A closely related quantity to the quantile spec- 
tral density is the copula spectral density, which is defined as 



where ^(^1,^2) = cov{I{F{Xq) < ui),I{F{Xr) < U2)) = E(/(F(Xo) < ui)I{F{Xr) < U2)) - 



U1U2, and F(-) is marginal distribution function of {Xt}. Note that by definition ui,U2 G [0, 1]. 



fh{i^) = :^^coy{h{Xo),h{Xr.))exp{iruj) = / / h{x)h{y)G{dx,dy;uj) 




{Xt}. 




(1) 



r 
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Thus, unlike the quantile spectral density, the copula spectral density is invariant to any mono- 
tonic transformation of {X^}, for example mean and variance shifts. By considering the ranks 
of {Xt}, the methods detailed in the section below can also be used to estimate Gc- Dette et al. 
(2011) have recently proposed Li-methods for estimating Gc, and the asymptotic sampling prop- 
erties have been derived for this estimator. 

In Figures 3, 4 and 5 we plot the quantile spectral density for the autoregressive {Xt = 0.9Xt_i + 
Zt), ARCH {Xt = atZt with = 1/1.9 + 0.9X2_ J and squared ARCH, with independent, identi- 
cally distributed (iid) Gaussian innovations Zt. The diagonals are of G{x, x; u), the lower triangle 
contains the real part of G{x,y;u) and the upper triangle the imaginary part of G{x,y;u). We 
observe that the AR and ARCH quantile spectral densities are very different. The AR has a 
similar shape for all x, whereas for the ARCH, it is flat (like the spectral density of uncorrelated 
data) at about the 50% percentile, but moves away from flatness at the extremes. Furthermore, 
recalling that the AR and ARCH squared have the same spectral density (if the moments of the 
ARCH squared exists), there is a large difference between the quantile spectral density of the 
AR and the ARCH squared. 

2.2.2 Estimating the quantile spectral density 

The quantile spectral density G{x, y; uj) can be considered as the cross spectral density of the 
bivariate time series {I{Xt < x),I{Yt < y)}. Therefore, our estimator of G{x,y]u) is motivated 
by the classical cross spectral. To do this we define the class of lag windows we shall use. 

Definition 2.1 The lag window takes the form 

r r 

H'^) ^ ( X] «r exp(i27rrii) - 6j|-uP)/[_i,i](M), 

j=-r j=l 

where /[_i^i](w) = 1 for u e [—1, 1] and zero otherwise. This class of lag windows is quite large, 
and includes the truncated window, the Bartlett window and general Tukey window (see, for 
example, Priestley (1981) Section 6.2.3 for properties of these lag windows). 

To obtain an estimator of G, we define the centralised, transformed variable Zt{x) = I{Xt < 
x) — Ft{x) (where Fx{x) = ^"^^t-^i-^t — -''))• estimate the quantile covariance Cr{x,y) = 
P{Xo < x,Xr < y) — P{Xq < x)P{Xr < y) with Cr{x,y) = Zt{x)Zt+r{y), and use as an 
estimator of G 

GT{x,y;uJk) = ^^\M{r)Cr{x,y)exp{irLJk) (2) 

r 

= y^^KMjuJk - ujs)JT{x;ujs)JT{y;ujs), 
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where Xnir) = A(r/M), Jt{x; u) = ^7= Zt{x) exp(ita;) and Km{uj) = Z)r ^^(r) exp(ira;). 
2.3 The test statistic 

The proposed test is based on the fit of the estimated quantile spectral density to the conjec- 
tured quantile spectral density. More precisely, we test Hq : G{x, y; uu) — Go{x, y; uu) against 
Ha : G{x,y;uj) ^ GQ{x,y;uj), where G is the quantile spectral density of {X^}, Go{x,y;uj) — 
^Z)r^o,r(2^,y)exp(ir(x;) and Co,r(x,y) = Fo,r(x,y) - Fo{x)Fo{y). Thus under the null the 
marginal distribution is Fo{-) and the joint distribution is Fo,r(-)- We use the quadratic distance 
to measure the distance between the estimated quantile spectral density and the conjectured 
spectral density, and define the test statistic as 

T 

1 X r ^ 1 x 

Qt = \Gt{x, y; ^^k) - ^M{r)Co,r{x, y) exp(ira;fe)|^dFo(x)dFo(y) 

fe=l ^ r 

= / \GT{x,y]Uk) - y^^KujuJk -Us)Go{us)?dFo{x)dFo{y) 

k=l s=l 

= ^E^^(^)'/ j \Cr{x,y)-CoA^,y)\'dFo{x)dFo{y), (3) 



where the above immediately follows from Parseval's theorem. The choice of lag window will 
have an influence on the type of alternatives the test can detect. For example, the truncated 
window (A('u) = /[_i^i](-u)) gives equal weights to all the quantile covariances, whereas the Bartlett 
window (A(-u) = (1 — |m|)/[_i,i](-u)) gives more weight to the lower order lags. Therefore the tests 
ability to detect the alternative will depend on which lags of the quantile covariance deviates the 
most from the null, and the weight the lag window places on these. We derive the asymptotic 
distribution of Qt in Section 3.2. 

Remcirk 2.3 The test can he adapted to he invariant to monotonia transformations (such as 
shifts of mean and variance). This can he done hy replacing the quantile spectral density with 
the copula spectral density Gc{-) defined in (1). In this case the null is Hq : Gc{x,y;uj) — 
Gc,o{x,y;uj) = ^ X)r^o,r(^il,^i2;<^) exp(ira;) against Ha : Gc{x,y]u) ^ Gc,oix,y;uj). The test 
statistic in this case is 

T 

1 V ^ f 1 V 

Qt,c = \GT,c{ui,U2;ujk) - —^XM{r)Co,r{ui,U2)exp{irujk)\'^duidu2, 

where we estimate GT,c{iJ'i,U2',uJk) in the same way as we have estimated Gt in (2) hut replace 
{Xt}t with {FT{Xt)}t- The distrihution of Qt,c is heyond the scope of the current paper. 
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3 Sampling properties 



In this section we derive the samphng properties of the quantile spectral density Gt and the test 
statistic Qt- We will use the a- mixing assumptions below. 

Assumption 3.1 Let us suppose that {Xf} is a strictly stationary a-mixing time series such 
that 

sup \P{AnB) - P{A)P{B)\<a{r), 

A(^u(Xr,Xr + l,...) 

Be<7(Xo,x_i,..) 

where a{r) are the mixing coefficients which satisfy a{r) < K\r\~^ for some s > 2. 



3.1 Sampling properties of Gt 

In the following lemma we derive the limiting distribution of Gt, this will allow us to construct 
point wise confidence intervals for G. 

Theorem 3.1 Suppose Assumption 3.1 holds. Then 

¥.{GT{x,y-uj)) = G{x,y;uj) + O(^), 
and for < cuk < tt we have 

yQGT{x,y;ujk)-QE{GT{x,y;ujk)) J 
Vrix, x; ujk)~^/'^ {Gt{x, x; Uk) - ^{Gt{x, x; cj^))) 4 J\f{0, 1), 

where M ^ oo and M/T as T ^ oo, 



VT{x,y;uJk) = 2_^KM{uJk-uJs) , ^, ^ = ^( 

^ \ C{x,y;ujs) B{x,y;ujs) J 



M 

rp )l 



and 



A{x,y;ujs) = ^(^G{x,x;uJs)G{y,y;uJs) + ^G{x,y;uJsf -^G{x,y;ujsf 

B{x,y;ujs) = ^(^G{x,x;uJs)G{y,y;uJs) + ^G{x,y;uJsy -^G{x,y;ujsf 
C{x,y;ujs) = ^G{x,y;uJs)'^G{x,y;uJs)- 
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Thus, if ^ >> j^2(s-i) 1 ill other words the variance of Gt dominates the bias, then we can use 
the above result to construct confidence intervals for G. 



3.2 Sampling properties of test statistic under the null hypothesis 

We now derive the limiting distribution of the test statistic under the null hypothesis. Let 

Et ^ ^ j jwM{uj-efG{x,x;e)Giy,y;e)dFo{x)dFoiy)deduj 

2 

J J AM{ei-92fYlG{x,,X2;9i)G{y,,y2;ei)deidFo{xi)dFo{yi), (4) 



Vt = 



4 

y2 



where 



i=l 



WM(e) = ^KM(e) = ^y] AM(r) exp(ire) 

r 



Am(^i -02)^ J WMiuj - e,)WM{uj - e2)du. (5) 

Lemma 3.1 Suppose that Assumption 3.1 holds andG{-) is the quantile spectral density of{Xt}. 
Then under the null hypthesis we have 

E{Qt) ^Et + O(^) = 0{^) and ^(Qt) = Vt + 0{^) ^ O(^). 
Using the above we obtain the limiting distribution under the null. 

Theorem 3.2 Suppose that Assumption 3.1 holds. Then under the null hypthesis we have 

v-^/\Qt-Et) 4a^(o, 1) 

as M ^ oo and M/T as T ^ oo. 

Using estimates of Gt{-), Et and Vt can both be estimated. Thus by using the above result, we 
reject the null at the a% level if ^^^(Qt — Ft) > Zi-a (where Zi-a denotes the 1 — a quantile 
of a standard normal distribution). 

3.3 Behaviour of the test statistic under the alternative hypothesis 

We now examine the behaviour of the test statistic under the alternative Ha '■ G{x,y;u) = 
Gi{x,y;u!) = ^ y) — Fi{x)Fi{y)^ exp{iruj). To obtain the limiting distribution we 
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decompose the test statistic Qt as Qt — Qt,i + Qt,2 + Qt,3, where 

1 /■ - - 2 

7 1 



2 



fe=i 

T 

Qt,2 = |;3fJ^ / [GT{x,y-u:k)-nGT{x,y-Uk))]\^{GT{x,y-u:k))-G{x,y-u^^^ 

k=l 

T 



Qt,3 = /"|E(GT(a:,y;c^fc))-G(x,y;a;fc)|'dFo(x)dFo(y), 

7 1 



k=l 

and 

G{x,y;ujk) = ^ ^ AM(r)Cr,o(a;, y) exp(irc^) ^"^KMiuJk - ujs)Go{x,y;ujs). 

r s 

Prom the decomposition of Qt, we observe that there are two stochastic terms Qt,i and Qt,2, 
and a deterministic term Qt,3- By using Lemma 3.1, it can be shown that Qt,i = Op{^^ + '^)- 
On the other hand, we show in the proof of the theorem below that Qt,2, is of lower order than 
Qt,i and, thus, determines the distribution of Qt- To understand the role that Qt,3 plays in the 
test, we replace G{x,y;uj) and E(G'r(2^, y; i^)) with Go and Gi respectively and obtain 

T 

2t,3 = /|Gi(x,|/;c^,)-Go(x,|/;(^fc)|Vo(x)rfFo(|/) + 0(-^ 

k=i 

Thus Qt,3 measures the deviation of the alternative from the null hypothesis, and shifts the 
mean of the test statistic. 

Theorem 3.3 Suppose that Assumption 3.1 holds, and for allr, sup^.^^ |Co,r(a;,y)| < K\r\~^'^'^^\ 
for some 5 > 0. Under the alternative hypothesis we have 

VTQt,2^N{Q,Vt,2), (6) 

and 

^[Qt-Qt,3) 4AA(0,V^t,2) (7) 



10 



where M ^ oo and VM/T as T ^ oo, and 
Vt,2 ^ J J AT{xi,yi;uj)AT{x2,y2;i^) 

Gi{xi,X2; u)Gi{yi,y2, u) + Gi{xi,y2, u)Gi{yi,X2] u)\dw^ dFo{xi)dFQ{yi) 

^ 1=1 

8 ^ 
"^T^ / / ^T{xi,yi;ui)AT{x2,y2;uj2)G(^^^y^,:c2,y2){'^ii-'^ii'^2)YldFo{xi)dFo{yi)dUi, 

where kT{x,y; Us) = ^ Er -^M(r)^(^^)[Ci,r(a;, - Co,rix,y)]exp{iruJk) and G(a:i,yi,x2,y2) the 
cross tri-spectral density of {{I{Xt < xi),I{Xt < yi),I{Xt < X2),I{Xt < y2))}t- 

The theorem above tells us that the mean of the test statistic is shifted the further the alternative 
is from the null. Interestingly, we observe from the definition of At(-), that the variance also 
depends on the difference between the null and alternative. However, for a fixed alternative, the 
power of the test converges to 100% as the sample size grow. 



4 Testing for equality of serial dependence of two time 
series 

The above test statistic can easily be adapted to test other hypothesis. In this section, we 
consider one such example, and test for equality of serial dependence between two time series. 
Let us suppose that {[/<} and {14} are two stationary time series, and we wish to test whether 
they have the same sequential dependence structure. Using the same motivation as that for the 
the goodness of fit test described above we define the test statistic 

1 ^ 

T^T = 7f,^ j \Gi,T{x,y;Uk) - G2,T{x,y;Uk)\^dF{x)dF{y), 

k=l 

where and G2,t are the quantile spectral density estimators based on {Ut} and {Vt} respec- 
tively and F is any distribution function. In order to obtain the limiting distribution under the 
null hypothesis we have Hq : Gi{x,y;uj) = G2{x,y;uj) and the alternative Ha '■ Gi{x,y]uj) ^ 
G2{x,y;uj) we expand Vt 

Vt '■= Qi,i,r + Q2,2,T — Qi,2,T — Q2,i,r + 2£i,t + 2£2,r + T^, 
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where 

Qi,j,T= ^ 5Z / [^iA^^V'^^k] -HGi,Tix,y;ujk))][Gj,Tix,y;ujk) -E{Gj^T{x,y;ujk))]dF{x)d^ 



k=l 



^i,T — 



and 



T 

E / [^^'^(^' - ^i^iA^^ ^fe))] H^iA^. VM)- E(G2,t(x, y; u))] dF{x)dF{y) 



T 
fe=i 



P = y y y |E(Gi,T(x,y;a;))-E(G2,T(x,y;a;))|^ciF(a;)ciF(y)cia;. 
Therefore, using the above expansion under the null hypothesis we have 

Vt '■= Ql,l,T + Q2,2,r ~ Ql,2,T ~ Q2,l,T-, 

where the moments are E{Vt) = Et,3 + O(^) = 0(f) and var(PT) = Vt,3 + O(^) = 0{^), 
with 

^T,3 - fj jwMiuj-e)''{G,{x,x;e)Gi{y,y;e) + G2ix,x;e)G2{y,y;e))dF{x)dF{y)deduj 

i=l 3=1 

By using identical arguments as those used in the proof of Theorem 3.2, under the null hypothesis 
we have 

Using the above result, we test for equality of sequential dependence, that is we reject the null 
hypothesis at the a-level if \V^^^'^{Vt — Et,z)\ > zi-a- 

The limiting distribution of the alternative can be derived using the same methods as those used 
to derive the limiting distribution of Qt under its alternative. It can be shown that 

Ml/2 

^ V ' J 

where 2Ci^t + 2jC2,t can be approximated by a quadratic form. Using this quadratic approxima- 
tion, asymptotic normality of the above can be shown. Thus under a fixed alternative the power 
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grows to 100% as T — >■ oo. 



Remark 4.1 We can easily adapt our method to test that the distributions of {Xo,Xr) and 
(X_r,Xo) are identical for all r (ie. Fr{x,y) = F-r{x,y))- This implies that the imaginary part 
of the quantile spectral density G(-) is zero over all x,y and cu. In this case, we use the test 
statistic 

= ^J2\^^Tix,y;u)\'dFix)dF{y), 

r 

where F is some distribution, and by using identical methods to those derived above we can obtain 
the limiting distribution of the test under the null. It is worth mentioning that Dette et al. (2011) 
also discuss the impact time reversibility has on the quantile spectral density. 



5 Bootstrap approximation 

The asymptotic normality result that we use to obtain the p-value of the test statisic Qt is 
only an approximation. For small samples, the normality approximation may not be particularly 
good, mainly because Qt is a positive random variable, whose distribution will be skewed. This 
may well lead to more false positive than we can control for in our type I error. 

To correct for this, we propose estimating the finite sample distribution of Qt using a frequency 
domain bootstrap procedure. In a multivariate time series, the periodogram matrix at the 
fundamental frequencies asymptotically follow a Wishart distribution, moreover for our purposes 
they are close enough to be independent such that we don't loose too much information by 
treating them as independent (observe that the asymptotic variance of the test statistic Qt is 
only in terms of the pair- wise distributions and does not contain any higher order dependencies) . 
Thus motivated by the frequency domain bootstrap methods proposed in Hurvich and Zeger 
(1987) and Pranke and Hardle (1992) for univariate data and Berkowitz and Diebold (1998) and 
Dette and Paparoditis (2009) for multivariate data, we propose the following bootstrap scheme 
to obtain an estimate of the finite sample distribution under the null hypothesis. 

Let xi < ■ ■ ■ < Xqhe Si finite discretisation of the real line (noting that we approximate Qt with 
the discretisation 

27r ^ ^ 

Qt = ^ \G{xi^,Xi^]Uk) - ^KM{i^k- ^s)GQ{xi^^_,Xi.,]Uk)\^ X 

k=l ii,i2=2 s 

{Fo{xn) - Fo{xi^-i)){Fo{xi.,) - Fo(a;i2-i)). 

We observe that under the null hypothesis that Gz{oo) will be the spectral density matrix of the 
multivariate g-dimensional time series Zj = {Zf{xi), • • • , Zt{xg)) where Zt{x) = I{Xt < x) — F{x) 



13 



and Gz(i^)ii,i2 = Go{xi^,Xi2;uj). Thus we use the transformation of Xf into a high dimensional 
multivariate time series to construct the the bootstrap distribution. 

The steps of the frequency domain bootrap for the test statistic Qt are as follows: 

Step 1: Generate T independent matrices Izi'^k) — Gz(u;fc)^/^Wj^Gz(u;fc)^/^, where 

r W^\l,I,) l<k<T/2 
W^^l W^ilJ,) ke{0,T/2} , 
( W*_^ T/2<k<T 

and PF*" and denote the complex and real Wishart distributions. 

Step 2: Construct the bootstrap quantile spectral density matrix estimators with G'^i^k) — 
Y,s Kuii^k - for A; = 1, . . . , T. 

Step 3: Obtain the bootstrap test statistic 

Qt= X] \G*{xi^-,Xi^;u:k) - Gq {xi^,Xi^;uk)\^{Fo{xi^) - Fo(a;i,_i))(Fo(a;jJ - FQ{xi, 

k=l ii,«2=2 

where G^{x,y;uj) = ^Y,f^X{^)Co,r{x,y)exp{iruj). 

Step 4: Approximate the distribution of Qt under the null by using the empirical distri- 
bution of the bootstrap sample {Qy}- 

Step 5: Based on the bootstrap distribution estimate the p-value of Qt- 

We illustrate our procedure in Figure 6, for this example we use the quantile spectral density 
Go, based on an ARCH(l) {Xt — ZtOt and dl = ao + aiX|_^), where oq = 1/1-9, oi = 0.9, Zt are 
iid standard normal random variables and T = 500. A plot of the normal approximation, the 
density of Qt (which is estimated and based on 500 replications) and the bootstrap estimator of 
the density (along with their rejection regions) is given in Figure 6. We observe that the skew in 
the finite sample distribution means that the normal distribution is under estimating the location 
of the rejection region. However, the bootstrap approximation appears to capture relatively well 
the finite sample distribution, and approximate well the rejection region. Since the bootstrap 
scheme is based on sampling from iid random variables, we can write the bootstrap test statistic 
as a quadratic form. Thus by using Lee and Subba Rao (2010), asymptotic normality of can 
be shown with mean and variance given in (4). Hence the limiting distribution of the bootstrap 
statistic and limiting distribution of the test statistic Qt, under the null, coincide. 
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6 Simulations and Real data examples 



6.1 Simulations 

In this section we conduct a simulation study. In order to determine the effectiveness of the test 
we will use two different models that have the same first and second order structure (thus a test 
based on the covariance structure would not be able to distinguish between them). In particular, 
we will consider the AR(1) model Xt = fi + aXt-i + St and the squares of the ARCH(l) model 
= Oo + oYt-i + {Z^ — l)(ao + (lYt-i), where {e^} and {Zt\ are iid zero mean Gaussian random 
variables with var(Zf) = 1 and /x and vax{et) chosen such that Xt and Yt have the same mean 
and covariance structure. Note that in the simulation we only consider a < 0.55, so that the 
spectral density of the squared ARCH exists. For each model we did 1000 replications and the 
tests was done at both the a = 0.1 and a = 0.05 level. 

In our simulations we used the Bartlett window, compared the test for various M and used both 
the normal approximation and the proposed bootstrap procedure. The results for Hq : AR(1) 
against the alternative '■ ARCH(l) (various a, fixing ag = 0-4) are given in Table 2 and 3. 
The results for Hq : ARCH(l) against Ha ■ AR(1) are given in Table 4 and 5. We use the sample 
sizes T = 100 and 500. 

As expected under the null hypothesis the null hypothesis tends to over reject, whereas the 
bootstrap gives a better approximation of the significance level. There appears to be very little 
difference in the behaviour under the null for various values of a and between the AR and the 
ARCH. Under the alternative, the power seems to be quite high even for quite small samples. 
The only model where the power is not close to 100% is when a — 0.3, sample size T = 100, 
the null is an AR(1) and the alternative is an ARCH(l). This can be explained by the fact that 
for small values of a, both the AR and the ARCH models are relatively close to independent 
observations, thus making it relatively difficult to reject the null. 

6.2 Real Data 

In this section we consider the the Microsoft daily return data (March, 1986 - June, 2003) 
discussed in Section 2.1 and the Intel monthly log return data (January 1973 - December 2003). 
In the analysis below we will test whether the GARCH and ARCH models are appropriate for 
the Microsoft and Intel data, respectively. We use the Bartlett window. 

A plot of the estimated Gt together with the piece-wise confidence intervals (obtained using the 
results in Theorem 3.1) and the corresponding quantile spectral density of the GARCH(1,1) is 
given in Figure 7 for the Microsoft data. It is clear from the plot that the GARCH(1, 1) model 
with coefficients evaluated using the maximum likelihood estimator is not the appropriate model 
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to fit to this data. The plots suggest that the main deviation from the GARCH(1, 1) arises at 
about x,y — 0, This observation is confirmed by the results of our test. Using various values of 
M ranging from 30 — 70, the p- value corresponding to Qt is almost zero with both the normal 
approximation and also the Bootstrap method. Therefore, from our analysis it seems that the 
GARCH(1, 1) is not a suitable model for modeUing the Microsoft daily returns from 1986-2003. 

We now consider the second data set, the Intel monthly log returns from 1973 - 2003. Tsay (2005) 
propose fitting an ARCH(l) (with Gaussian innovations) model to this data, and maximum 
likehhood yields the estimators ji — 0.0166, Oq = 0.0125 and Oi = 0.363, where Xt — ji -\- St, 
St — (TtZt and — -\- aiel_^. A plot of the estimated Gt with the piece- wise confidence 
intervals together the quantile spectral density of the ARCH(l) model is given in Figure 8. We 
observe that quantile spectral density of the ARCH model lies in the confidence intervals for 
almost all frequencies. These observations are confirmed by the proposed goodness of fit test. A 
summary of the results for various M, using both the normal approximation and the bootstrap 
method is given in Table 1. The p- values for the normal approximation tend to be smaller than 
the p-values of the bootstrap method, this is probably due to the skew in the finite sample 
distribution which results in smaller p-values. However, both the normal approximation and 
the bootstrap give relatively large p-values for all values of M . Therefore there is not enough 
evidence to reject the null. This backs the claims in Tsay (2005) that the ARCH(l) may be an 
appropriate model for the the Intel data. 



M 


15 


20 


25 


30 


Normal p-value 


0.0905 


0.1279 


0.1807 


0.2643 


Bootstrap p-value 


0.3880 


0.4320 


0.4020 


0.4780 



Table 1: The p-values for the Intel Data and various values of M 
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A Proofs 



To obtain the sampling properties of Gt{-) and Qt (under both the null and alternative), we first 
replace the empirical distribution function Ft{x), with the true distribution and show that the 
error is negligible. Define the zero mean, transformed variable Zt{x) = I{Xt < x) — F{x), where 
F(-) denotes the marginal distribution of {Xt}. In addition define Crix, y) — ^ Zt{x)Zt+r{y), 

GTix,y;ujk) = ^ Am (r) (7^(3:, y) exp{irujk) ^^KM{uJk - ujs)JT{x;ujs)JTiy;i^s), 



1 

Qt = \GT{x,y]UJk) -'^XM{r)Co,r{x,y)exp{iruJk)\^dFo{x)dFQ{y). 

k=l r 

where Jt{x;uj) = ;y=YlJ=i^t{x)exp{itu;). 

In the proofs below we shall use the notation \\X\\r — (E{\X\'^)y^'^ . We first show that replacing 
Ft{x) with F(x) does not affect the asymptotic sampling properties of Gt{-) and Qt- 

Lemma A.l Suppose Assumption 3.1 holds. Then we have 

mCTix^y-u) - GT{x,y-u:)\y = oA (8) 



and 



{mT-QT\Y'^o{^). (9) 



PROOF. We first observe that 



JT{x;ujk)JT{y;(^k) - JT{x;ujk)JT{y;i^k) 

Wfc 7^ 0, TT 

T{Ft{x) - F{x)){FT{y) - F{y)) otherwise 
Substituting the above into Gr(<^s) — Gt{uJs) gives 

Gt{uJs) - Gt{uJs) = TKm{u:s){Ft{x) - F{x)){FT{y) - F{y)). (10) 
Using Km{-) = 0(f) and \ \Ft{x) - F(a;)||2 = 0{^) in (10), we obtain the desired result for (8). 
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To prove (9) note that 



Qt — Qt 

T 



^ I {GT{x,y;LJs) - GT{x,y;LJs)){GT{x,y]Us) + GT{x,y;Us))dFo{x)dFo{y) 

s=l 

+ '^(^J {GT{x,y;ujs) - GT{x,y;ujs))G{x,y;ujs)dFo{x)dFo{y)^ . 



Thus substituting (10) into the above gives 



Qt ~ Qt 

j{FT{x)-F{x)){FT{y)-F{y))x 

T 

Km{u}s) {Gt{x, y; ojs) + Gt{x, y; ojs)) 1 dFo{x)dFo{y) 



s=l 



+ 2 J {Ft{x) - F{x)){FT{y) - F(y))sR(^|]i^MK)G'(x,y;a;,)^dFo(x)dFo(y). 



Therefore 



1 1 Qt — Qt 1 1 2 

< J \\Ft{x) - F{x)mFT{y) - F{y)lx 

■ T 

J2{\Km{uJs)\ ■ {\\GT{x,y;cUs)\\, + \\GT{x,y;ujs)\l)) ) dFoix)dFoiy) 

■ s=l 

+ 2 1 \\FT{x)-F{x)UFT{y)-F{y)lx 

T 

Y,\Km{us)\ ■ \G{x,y;cJs)\)dFo{x)dFo{y). 



s=l 



For all r > 2, we have \\Ft{x) — F{x)\\r = 0{^), substituting this into the above gives \\Qt — 
Qt\\2 = and the desired result. □ 

PROOF of Theorem 3.1 To show asymptotic normality of Gt{-), we first replace Gt with Gt, 
by (8) the replacement error is Op{^). Thus Gt and Gt have the same asymptotic distribution 
and we can show how asymptotic normality of Gt by considering Gt{-) instead. To show 
asymptotic normality of Gt we use identical methods to those in Lee and Subba Rao (2011), 
where, since {I{Xt < x)} are bounded random variables, we can use Ibragimov's covariance 
bounds for bounded random variables. To obtain the limiting variance we note that under 
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Assumption 3.1, since s > 2, we have that X^r- I'^l ' |cov(/(Xo < x),I{Xr < y))\ < oo and 
E.i,r.,,r-.(1 + k.l)|cum(7(Xo < Xo),I{Xr, < Xi),7(X,, < X2),I{Xr, < Xs))\ < OO. Thus, the 
assumptions in BriUinger (1981), Theorem 3.4.3 are satisfied, which allows us to obtain the 
stated limiting variance. □ 

We use the following lemma to obtain a bound for the variance of Qt- 

Lemma A. 2 Let the lag window be defined as in Definition 2.1 and suppose hi{-) and h2{ ) are 
hounded functions. Then we have 

i-l = y hi{ui)h2{u2)/^M{ui - U2fdUidU2 = 0{M) (11) 

and 

-^2 = y" hi{ui)h2{u2)/^M{ui + U2)/^m{ui — U2)duidu2 = 0{l) (12) 
where Am(-) is defined in (5). 

PROOF. To simplify notation we prove the result for the truncated lag window \{u) = /[_i^i](-u), 
but a similar result can also be proven for lag windows which satisfy Definition 2.1. In the proof 
we use the following two identities 

fe- = e^^^?^ and ( / | ^'^^ W = 0(M-^-). (13) 
^ sm(a;/2) V ' sm{{u)/2) I ^ ^ ^ ^ ^ 

We start by expanding Am and using the above, to give 

„ M 

Am(6'i - 6*2) = / ^ AM(ii)AM(i2) exp{iji{ujsi - 0)) e^p{ij2{ujs2 - 0))dw 

iij2=-M 

= ^ >^M{j)>^M{-j) exp(ij(6'i - 62)) 



sin((M + l)(gi-g2)/2) ,^^^M(.,-.,) 

sin((^i - ^2)/2) ■ ^'^^ 

Substituting the above and (13) into (11) gives 

r r f f sin (^^^^-^( Ml ^2)) 2 

l-t'il = I / / hi{ui)h2{u2) Am{ui - U2)^duidu2\ < snp \hi{u)\'^ / / | . ^ wo^~l duidu2^0{M). 

J J u,i J J sm[[Ui — U2) / 2,) 

This proves (11). To prove (12) we observe that by a change of variables {vi — ui — U2 and 
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V2 — ui + U2) we have 

\L2\ - ^ J \^m{ui + U2)\ ■ \^m{ui - U2)\duidu2 < C( J \AM{u)\duY. 

Now by substituting (14) and (13) into the above gives L2 — 0{1). Thus we have obtained the 
desired result. □ 

PROOF Lemma 3.1 We first evalulate the expectation of Qt- By using Lemma A.l we have 
E(Qr) 

I ^ f ^ _ ^ _ ^ 1 

^ 5Z ^M{uJs-uJkjKM{uJs-ujk^)coy{JT{x;ukJJT{y;ujkJ,JT{x;uk^)JT{y;^ 

S=l ifci,fe2=l 

= 7, + 72 + /3 + 0(^), 
where 

T 2 



/i = ^ y ^ ]^irM(t^s -^^feJcov(JT(x;wjkJ, JT(x;wfcJ)cov(JT(y;a;feJ, 

s,fci,A;2 = l «=1 

^ f ^ ]^Km{(^s - <^ki)coy{JT{x;(xikJ,JT{y;(^k2))coy{JT{y;(^ki),JT{y;^^^^ 

S,fel,fc2 = l 2=1 

^ f ^ ]^ii'M(<^s -^^feJcum(jT(x;6^feJ, JT(y;c^fci),^T(a;;a;feJ, Jr(y;wfeJ)dFo(a;) 



S,fel,fc2=l *=1 



Under Assumption 3.1, we have that Ylr 1^1 ' |cov(/(Xo < x), /(X^. < y))\ < 00 and ^^.^ ^,^(1 + 
|rj|)|cum(/(Xo < Xo),I{Xr-i < xi),I{X.,.,^ < X2),I{Xrg < ^3))! < 00. Therefore we can apply 
Brillinger (1981), Theorem 3.4.3 to obtain 

T T 

I f f 1 M 

^ fJ2 I]^M(u;.-a;fe)2 / G{x,x;ujk)G{y,y;ujk)dFo{x)dFo{y) + 0{-) ^ 0{—) 

s=l k=l 
T T 

1 , C - C 11 

-^2 = I ^Km{uJs- ^k)KM{(^s + ^^k) I G{x,y;LJk)G{y,x;Uk)dFo{x)dFo{y) + 0{-) = 0{- 

T 

I^^M{rf 2^ CM-m{Zt^{x),Zt^+r{y),Zt^{x),Zt^+r{y))dFo{x)dFQ{y) = 0{- 



r ti,t2=l 

This gives us an asymptotic expression for the expectation. We now obtain an expression for the 
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variance. Replacing Zf{-) with Zt{-) gives 

yeniQ-r) = 

Sl,S2 = l ^ kl,k2,k3,k4 

XCOV ^(t/fcj^ ^xiJ k\,yi ^(^Jki,xiJki,yi))(^Jk2,xiJk2,yi ^i.'^k2,xiJk2,yi^^ y 

{Jk3,X2Jk3,y2 ~ '^{Jk3,X2J k3,y2)){JkA,X2J kA,y2 ~ ^{JkA,X2Jk4,y2)))ldFo{Xi)dFQ{yi)dFo{x2)dFo{y2) + 0{ 



where Jk,x ^ Jrix-^Uk), 

T 

~ ^ ^ CUrn( J/jj^a-j Jj.^^j^^, Jj-g^a-j J/j3_y2)cuni( Jfc2,a;i<^fe2,yi) 

S1,S2 = 1 k\,k2,k3,kA 

2 4 

1 ^ f 

— 7^ ^ ^ / ^ ] ^^^{Jk\,x\Jki,yi-i J kA,X2JkA,y2)^^^{Jk2,xiJk2,yi-i Jk3,X2Jk3,y2) 

Sl,S2 = l kl,k2,k3,kA 

2 4 

'^52 ~ ^ki)dFo{xi)dFo{yi)dFo{x2)dFo{y2) 



=1 j=3 
T 



//3 = 



^ ^ ^ ^ ^ ^ ^^^{Jk\,x\Jki,y\^ Jk2,xiJk2,yn Jk3,X2Jk3,y2i J kA,X2JkA,y2) 

Sl,S2 = l k\,k2,k3,kA 

2 4 

^S2 ~ '^fei)c?-^o(3^i)c^-^o(yi)c^-^o(2^2)c^-^o(y2)- 



i=l j=3 
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To obtain an expression for the variance we start by expanding IIi 
1 r ^ 4 

si,S2 k\,k2,kz,k4 i=l i=3 



X 



;COv(4...,4..)cOv(7,,„,7,„)c„v(4.„,..,„)cOvft,..,7,,„, 

+ COvi^Jy^^ xii Jk3,X2)^^^{J ki,yn J k3,y2)^^^{Jk2,xn J k4,y2)^^^{'^ k2,yn JkA,X2) 
+ COv( Jfej^j;-^, Jk3,X2)^^^^J k\,y\i J k3,y2)^^^{Jk2,xn Jk2,yii JkA,X2i "^^4,2/2) 

+ COv(Jfei,j;i, Jfc3,2/2)C0v(Jfc^,yi, Jfc3,a;2)C0v(Jfc2,a;i, -^fe4,X2)C0v(Jfc2,yi, -'^^4,^2) 
-|- COv(t/fcj -j^j , J k3,y2^^^^i.'J ki,yi 5 •Jks,X2^^^^i.'Jk2,xi 5 "-^ fe4 ,j/2 ) ( fe,?/! ; '^k4,X2) 
-\- COv(t/^j , t/ ks ,y2^ {."J ki,yi 5 '-^fe3,2;2 )c^'^('-^A;2,3;i ^ J k2,yi^ J k4,X2 5 "-^ fc4,y2 ) 
~l~ CUni(t/fcj y J j^-^ y-^^y J k3,X2 5 "-^ k3,y2^^^^i,Jk2,xi ; "-^ fc4,2:2 )*-''-'^('^ 's2iyi 5 k4,y2 ) 
+ CUni( Jfej^^-rj^, Jk\,yii Jkz,X2i kz,y2)^^'^^'^k2,x\i J kA,y2^^^^^'^ k2,yii JkA,x2) 

+ CUm.{Jk^^xi, J kx,yi, Jkz,X2-: J kz,y2)^^'^{Jk2,xi-, J k2,yi-, Jk4,,X2-, J k4,,y2) ) JJ^ "^-^ola^jOf^-fod/j) 

9 

i=i 

We use (Brillinger, 1981), Theorem 3.4.3 to obtain the following expression for IIi^i 

Ih,l^ { {YlKM{i^Si-i^ki)KMii^Si-^^k2)) 

si,S2 ^ ki,k2=l i=l 

COv(Jfc]^ -ri) Jki,X2)^^i'^ ki,yn J ki,y2)^^"^i.Jk2,xi-i Jk2,X2)^^^i.J k2,yi-i Jk2,y2^}^ 

Y[dFo{x,)dFo{y,) + 0{-) 

y Wm{,i^s2 - Oi)Wm{,i^s2 - d2)duJs^ n '^'^^i' ^0^(2/1, 2/2; -Oi)dei 

2 1 
nc^Fo(x,)(iFo(%) + 0(-) 

2 2 

= Y2 I I ^M{ei-e-,f\{G{x^,x-,-e,)G{yr,y-,--ei)de,\{dFo{x^)^^^^^ 

i=i j=i 

Therefore by using (11) we have IIi^i — 0{j^). We now consider //i,2, by using a similar method 
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we have 



Ih,2 = ^ j (wM{uJs,-ei)WMiuJs,-02)WM{oOs,-O,)WMioOs,+O2)x 

G{xi, X2, 9i)G{yi, y2, -9i)G{xi, 1/2, 92)G{yi, X2, -82) j d9xd92dus^(hjs^ J]^ dFo{xj)dFQ{yj) + 0{—) 
= ^ j AM{9i-92)AM{9, + 92)G{xi,X2,9,)G{y,,y2,-9i) 



G(x,, y2, 92)G{y^, X2, -92)d9,d92 J] dFo(xj)dFo(yj) + 0{—). 



By using (12) the above integral is 0(1), and altogether 77i^2 = O(^). Using a similar argument, 
one can show that //i,3, //i,4 are smaller than O(^), so neghgible. For //i,5, we use that 



COv(Jfc^,a;, Jk2,y) 



G{x,y,Uk^) ki + k2^T 
0(h) otherwise 



, which follows from (BriUinger, 1981), Theorem 3.4.3. This leads to 

Ih,5 = j { {Y\^KM{Us^-UJk,)KM{i^S2+^ki)) 

Sl,S2 ^fel,fc2 = l i=l 

CGvi^Jkx^xxi Jk\,y2)^^^^J k]_,y\i J k\,X2)^^^^Jk2,x\i •^fe2 ,2/2 ) ( "^fe ,2/n ^ k2,X2) 

Y[dFo{x^)dF,{y^) + 0{-) 

SI I X 

Wm{.i^s2 + 9i)Wm{.i^s2 + ^2)(it^s2) n ^^^1' ^i)G{yi, X2] -9i)d9, 

\[dF,{x^)dF,{y^) + 0{^) 

i=i 



i=l 



because of A(^) = A (—6') and interchangeability of integrals about (xi, X2,yi, ^2)- With a similar 
method, one can show that IIi^ . . . , //i^g are all dominated by and //i,5 Altogether this 
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gives 



2 2 



Using the identical argument with the above, we can show that 

2 2 

^ 2^2' 



2 2 

i=i 7=1 



To bound 7/3 we recall that 

T 



si,S2=l fei,A;2,*;3,fc4 



CUm(jfc^^-r^ Jfej^j^^, Jk2,xiJk2,yi^ Jkz,X2J kz,y2^ Jki,X2Jk4,y2)dFo{xi)dFo{yi)dFQ{x2)dFQ{y2) + 0{ — ). 

By using the method of indecomposable partitions (see (Brillinger, 1981), Theorem 2.3.2) to 
partition the above cumulant of products into the product of cumulants. This together with 
(Brillinger, 1981), Theorem 3.4.3 gives us II3 — 0{^) (see Lee's thesis for further details). 

Combining the expressions for IIi, II2 and lis gives us the expression for the variance and 
completes the proof. □ 



A.l Proof of Theorem 3.2 

Now we show that Qx can be approximated by the sum of martingale differences, this will allow 
us to use the martingale central limit theorem to prove Theorem 3.2. 

We first define the martingale difference decomposition of Zt{x) = Yl]=o-^j^\t ~ j)i where 
M'f\t-j) = E{Zt{x)\J^t-j) - HZt{x)\J^t-j-i), where for t > we have J^t = a{Xt,Xt-i, ...,Xi) 
and for i < we let — c"(l)) and Mj{s) — for j > s. Using the above notation we define the 
random variable 




xM^^>{t2-j3)M^yj{t2 + r-u)dFo{x)dFo{y), (15) 
where A — {{ti — ji,ti + r — j2, t2 — j3,t2 + r — j^) are all different }. 

Theorem A.l Suppose Assumption 3.1 holds, St is defined as in (15) and the null hypothesis 
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is true. Then we have 



1 Ml/2 



and for allr>2 \\St\1^0{^). 

PROOF. We prove the result using a combination of iterative martingales and Burkholder's 
inequality for martingale differences. We note that for r > 2 we have 

\\K'\t-j)\\r = \\E{Zt{x)\J^t_,) -E{Zt{x)\:Ft_,_,)\\, < 2\\E{Zt{x)\J^t-Mr < Ca{j),{16) 

where Tt — cri^t, ^t-i, ■ ■ ■ , ^i), which follows from Ibragimov's inequality. Substituting the 
representation Zt(x) — Mj^\t — j) into Qt gives 



Qt-E{Qt) 

ji,...j4=0 r=-M tiM ^ 

- E{M^f{t, - 3,)M^f{t, + r - j2) X M^f{t^ - js)M^!\t, + r - J4)))) dFo(^)cii^o(?/), 

where X denotes the centralised random variable X — E{X) (note that Mj{s) = for s < 0). We 
now partition the above sum into several cases, where we treat ji, . . . ,j4, as free and condition 
on ti,t2 and r: 

(i) A = {{ti, t2, r) such that {ti — ji, ti + r — ^2,^2 — js, t2 + r — j4) are all different }. 

(ii) B ^ {{ti,t2,r) such that {ti - j^^ ^ti + r - 32) and {t2 - is = ^2 + r - ^4)}. 

(iii) C = {{ti,t2,r) such that (ti -ji) = (^2 -Js) or (^2 + ^-^4) and (ti + r - ja) 7^ (^i -Ji)}- 

(iv) V = {(ti,t2,r) such that (ii+r-ja) = (^2-^3) or (^2 + ^-^4) and (ii-ji) 7^ (^i + r-ja)}- 

(v) £ = {{ti, t2, r) such that (^2 - Js) = (^i - ji) or (ti + r - ^2) and (^2 + r - ^4 7^ ^2 - ja)}- 
(iv) 7"= {(ii,i2,r) such that (^2 + ^-^4) = {ti-32) or (ti + r-j2) and (^2-^3) 7^ (^2+r-j4)}. 

Thus 

Qt - E(Qt) = j {ia + Ib + Ic + Iv + Is + It^ dFo{x)dFo{y), 
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where 

= ^ E E ^M{rrMi:\ti-mi!\ti + r-h)M^fit,-js)M^^\t, + r-j,), 

ji,...,j4=0 r,ti,t2eA 



1 °° / 

Ib - E >^M{h-h)\M^:\t,-3,)M^f{t,-j,)xM^:\t,-3,)M^f{t,^ 

ji,...Ji=0r,ti,t2eB ^ 

for Ic, Ijr are defined similarly. 

We first bound I^- We partition A into 24 cases by the order of (ti— ji, ti+r—j2, ^2— Ja, ^2+^— J4)- 
The first is Ai — {{ti,t2, r) such that ti — ji > ti + r — j2 > t2 — js > t2 + r — ^4} which gives 

^ 00 

^Al - ^ E E Mr)X'n^l-il)<H^l+r-j2)<^n^2-j3)<)(t2 + r-j4). 

Ji,...j4=0r,ti,t2e»4i 

The other 23 cases arc defined similarly (different orderings of ti —ji, . . . , ^2+^—74); such that we 
have Iji = Yl'^'Li I Ay We start by bounding Ij^i. Since ti— ji > ti+r—j2 > ^2— js > t+r—j^, it is 
easy to see that M|^)(ti-jOE.<,wi AM(r)X'^(ti + r-j2) E*,<*,-,,+,3 <'^(^2-j3)Mjf (^2 + 
r - ji) is a martingale over ti, Mjf (ti + r - J2) J2t2<h-n+js M^jfih - is)^]^ (ta + r - ji) is a 
martingale over r and {Mjg^-'(t2 — jz)M^^^\t2 + r — j^)} is a martingale over t2- Thus by using 
Burkholder's inequality together with Holder's inequality three times, for any q >2 we have 

iiuiii. = ^ E (E^^(^)'iiMrH^i-j'i)ii4.ii<H^i+r-j2)ii^, 
iKr^(^2-i3)ii^jiMjf(t2+r-i4)iiy'/'. 

Thus by using (16) we have that = 0(^^^^) and by the same argument we have /^j = 

O(^) (for 2<j< 24). Therefore, altogether this gives ||7^||g = O(^). We now bound Iq. 
We first define the random variable 



31,12? 

E(Mjf^(ii - j\)Mjf (ii - iOI-Ft,-,,-.) -E(M]f^(ii - jOMjf (ii -j,)\J^ti-n-i). 
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To bound \\Af^j.li{ti — ji — i)\\q, we repeatedly use Ibragimov's inequality and (16) to give 

< Ca{i)\\M^fih-h)M^fih-jr)\U<Ca{i)aijr)a{j^^^ (17) 

This gives the representation 

i 

Substituting the above representation into Ib gives 

^ oo 

^ = ^ E E Mii-i2)^[4;£n(^i-ii-o^S.(^2-i3-i2) 

jl,... J4,jl,i2=0 ti,t2eB 

-E(^5S;n(^l-il-0^S.(^2-i3-^2))] 

where 

^ oo 

^.1 - ^ E E ^Min - J2)'4i..(t, - ^1 - -JS- ^2) 

Jl,...,j4,«l,*2=0 il— Jl-il>t2— is— *2 
^ OO 

- ^ E E ^Mih - j2}'4']L(t. -ji- ^)4;£.(^2 -h- ^.) 

ili---j4,n,i2=0 tl— jl— il<t2— J3— *2 
^ OO 

^,3 ^ E E ^M(ii - i2)^AS,,(ti - ii - i)^g£;.(^2 - ia - i2). 

Ji I ■ • • J4 , n ,12 =0 1 1 — ji — ii =t 2 —ja—h 

Using similar techniques to those used to bound Burkholder's and Holder's inequalities 

twice on together with (17), we obtain the bound = A similar argument 

can be used for ||/b,2||(j = 0{^). To bound ||/B,3||g, we need to decompose 

- - - ia - ^2) - E(.lSn(t, - - i)^S.2(^2 - h - k)l 

into the sum of martingale differences, using this martingale decomposition we can use the 
same argument as those used above to obtain ||/b,3|| = 0{j^). Therefore, altogether we have 
W^bWq = 0{^). Now by using similiar arguments and repeated decompositions into martingale 
differences we can show that . . . , = 0{^^^). Thus we have shown that /_4 is the 

dominating term in Qt — ¥.[Qt). Since St = J /^(iFo(a;)(iFo(y) we have obtained the desired 
result. □ 
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To prove the result we use the martingale central limit theorem on 



ji,...,j4=0ti,r,t2e-4 



To do this, we use the same decompositions of as that used in the proof of Theorem A.l. We 
set ST,i '■= lA,i, recalling that 

^T, = ^ E E AM(r)^M(fnti-j\)<^^(ti + r-j2)<^H^2-j3)M|f(^2 + r-j4), 

ji,...j4=0 r,ti,t2eA,i 

where Ai is an ordering of {ti — ji,ti + r — ^'2,^2 — j3,h + r — j4}. We show that Sr^i can 
be written as the sum of martingale differences. First consider St,i, this can be written as 
«5t,i = ^ 5^fe=i Uk,i, where with a change of variables we have 

T—k 

C/m = Jj2^nik) J2 E ^M{rrM^:\k + n + r-j,)M^f{t,-js)M^^\t, + r-M)dF,{x)^^^^ 

and Ak,i = {{r,t2) such that {k > k + j'l + r — j2 > t2 — js > t2 + r — ji)}. Using a similar 



ove . 



argument we can decompose Sr^i as St^i = Sfc=i (and Uk^i is defined similar to ab 
Therefore, altogether St is the sum of martingale differences, where St = Yl^=i Yld=i ^k,i, 
and Yliti Uk,i € a{Xk,Xk-ii ■ ■ ■) are the martingale differences. Therefore under the conditions 
in Theorem A.l we have 

1 I J^Jt. 1 Ml/2 

Qt - E(Qt) =St + 0,{- + -j^) = —Y^Y,Uk, + 0,{- + -j^). 

fc=l i=l 

These approximations will allow us to use the martingale central limit theorem to prove asymp- 
totic normality, which requires the following lemma. 

Lemma A. 3 Suppose that Assumption 3.1 holds. Then for all 1 < i < 24 and 1 < k < T we 
have 

24 

\\Y,Uk,i\U = 0{T'/'M'/') (18) 
1=1 



T2ME^(E^y-^M / h^M{9i-92rYlG{x,,X2;9,)G{y,,y2;9,)de,YldFo{xj)dFo{yj) (19) 

k=l i=l i=l 1=1 
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and 



^ T |- ^ 24 X 24 

k=i L ^ "-I ^ "-I 



1=1 ^ i=l 



4 0. (20) 



PROOF. To prove the result we concentrate on Uk,i, a similar proof applies to the other terms. 
By using the Holder inequality, for any q >2, we obtain 



T-k 



M^.^\t2 - j3)M^f{t2 + r - j4)\\4,/3dFo{x)dFo{y). 

Now by repeated use of Burkholder's inequality we have = 0(M^/^T-^/^), using a similar 

method we obtain a similar bound for this gives (18). 

The proof of (19) follows from the proof of Theorem A.l (noting that the asymptotic variance 
of Qt" is determined by the variance of St)- 

To prove (20), we consider only the Uk,i (the proof involving the other terms in similar). For 
brevity we write Uk,i as 

T-k 



ji=0 

where 

<7-M = E E AM(r)^Mj^)(^ + ji + r-i,)Mjf(t2-i3)<^(t2 + r-i4). 

j2,j3,ji r,tieAk,i 

Noting that A^if'fL , G Tk-i we have 

^Y,muk,f\Tk-,)-^Uk,,Y)^ 

k=l 

T „ T-k 



k=l ji,j2=0 i=l 
T T—k 2 

+^E / E nMi\k)Mf:\k))){Nf^}^_%^^^^ 

Now by using similar methods to the iterative martingale methods detailed in the proof of 
Theorem A.l, we can show that the || • H^-norm [q > 2) of the above converges to zero, thus we 
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have (20). 



PROOF of Theorem 3.2 Using the above we have Qt = ^ ELi E?=i Uk,i + Op{^ + 
thus Qt — E(Qx) can be written as the sum of martingales plus a smaller order term. Therefore 
to prove asymptotic normality of Qt we can use the martingale central limit, for this we need 
to verify (a) the conditional Lindeberg condition ELi ^^(1 Ei=i Uk,i\^I{j^^\ Ei=i Uk,i\ > 
e)\n-i) 4 for all e > 0, (b) that ^ ELi^d E?=i C^mI Vfe-i) - ^^^<Qt) ^ 0. 

To verify the conditional Lindeberg condition, we observe that the Cauchy-Schwartz and Markov's 
inequalities give 

^ T 24 24 T 24 

k=l 1=1 i=l k=l i=l 

By using (18) the expectation of the above is K{Bt) = O(^). As is a non-negative random 

v 

variable, this implies Bj- — > as T — )■ oo. Thus we have shown that the Lindeberg condition is 
satisfied. To prove (b) we note that 



. T . 24 \ t2 

MT^E^ IE ^Mri-^.-i -^var(g.) 

k=i ^ i=i ^ 



T p 24 24 -, T 24 „2 



fe=i 



i=l i=l 



k=l i=l 



By using (19) and (20) the above converges to zero in probabihty. Thus we have verified the 
conditions of the martingale central limit theorem and we have the desired result. □ 



A. 2 Proof of Theorem 3.3 

As the limiting distribution of Qt is determined by Qt,2, we rewrite Qt,2 in such a way that the 
same methods used to prove Theorem 2 in Lee and Subba Rao (2010), can be used to obtain the 
limiting distribution. We observe that 

Qt,2 ^ I ^^T{x,y]UJk){JT{x]UJk)JT{y]^^k) -HM^'^^k)JT{y;^^k))}dFo{x)dFo{y) 



/IE 



t,T 

Xuit - TfDt_rA^,y){ZT{x)Zr{y) - Cr{x,y))dFo{x)dFo{y) + Op(^), 

t,T 
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where Arix^y; Us) = J2r ^M{rf{'^^)[Cr,i{x,y)-Cr,o{x,y)]ex.p{irujk), Dr,T{x,y) = {'^^)[Cr,i{x,y)- 
Cr,oix,y)] and Zt{x) = I{Xt < x) - Fi{x). 

PROOF of Theorem 3.3 Now we observe that under the stated assumptions of the theorem we 
have that the quantile covariances under the null decay at the rate sup^ \Crfi{x, y)\ < K\r\^^'^^^^ 
(for some 5 > 0) and sup^, \Cr,i{x,y)\ < K\r\^^ (for some s > 2). Thus by definition of Dr^ri'), 
we have sup^.^^ \XM{r)Dj.^T{x,y)\ < i^|r|~™™(2+i5,s)_ ^j^^g (.^n write Qt,2 as 

Qt,2 = f I J]AM(t-r)2A-r,T(a;,t/)(^T(x)^r(|/)-E(ZT(x)Z,(y)))ciFo(x)ciFo(y) + Op(^), 

t,r 

where we observe that terms where |i — t| > 2M, are zero. Thus using the Bernstein blocking 
arguments for quadratic forms used to prove Theorem 2, Lee and Subba Rao (2011), we can 
show asymptotic normality of the above. This proves (6). Finally to prove (7), we note that 
Qt = Qt,2 + Et,2 + Op{^^ + f + M^^), by using (6), this immediately leads to (7). □ 
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GARCH fit to MSFT data ACF plot 
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Figure 1: The ACF plots of {Xt} and {\Xt\} of the MSFT and the corresponding GARCH model 
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Figure 2: The quantile covariance of the MSFT and the corresponding GARCH 
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Figure 3: The quantile spectral density of Xt — 0.9Xi_i + 



0.04 
0.02 



-0.02 : 
0.04 



-0.02 : 
0.04 



Q» O-S^ 0<S^ O-S^ r^cChr O -ar -K^ <&r Stt « ^ O. ^ O. ^ O. fi^r 



Figure 4: The quantile spectral density of Xt = (JtZt^ where = 1/1.9 + Q.9X^_^ 
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Figure 5: The quantile spectral density of — alZl, where erf = 1/1.9 + 0.9X|_i 
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Q-j- with "r=500, AFRCJMT , M=25 
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Figure 6: The fine line is the standard normal (with the 5% rejection line), the thick solid line 
is the finite sample density of the test statistic (with 5% rejection region) and the thick dashed 
line is the bootstrap approximation (with 5% rejection region). 
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Figure 7: The quantile spectral density of the fitted GARCH(1, 1) model using Microsoft data 
with the confidence intervals 
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Figure 8: The quantile spectral density of the fitted ARCH(l) from Intel data with the confidence 
intervals 



Table 2: Hq : AR{1), Ha : ARCH T = 100 



T = 


100 




a — 


0.1 






a — 


0.05 




Bootstrap 


Normal 


Bootstrap 


Normal 


a 


M 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 




11 


0.052 


1 


0.076 


1 


0.021 


0.972 


0.054 


1 


0.3 


16 


0.04 


0.869 


0.062 


0.971 


0.011 


0.262 


0.04 


0.854 


21 


0.048 


0.386 


0.064 


0.561 


0.021 


0.106 


0.043 


0.348 




25 


0.021 


0.071 


0.048 


0.229 


0.014 


0.016 


0.029 


0.12 




11 


0.048 


1 


0.082 


1 


0.02 


1 


0.055 


1 


0.4 


16 


0.043 


1 


0.059 


1 


0.013 


0.939 


0.041 


1 


21 


0.046 


0.932 


0.066 


0.997 


0.011 


0.416 


0.046 


0.929 




25 


0.036 


0.582 


0.055 


0.832 


0.01 


0.124 


0.037 


0.598 




11 


0.046 


1 


0.073 


1 


0.015 


1 


0.052 


1 


0.5 


16 


0.049 


1 


0.078 


1 


0.027 


1 


0.045 


1 


21 


0.046 


1 


0.06 


1 


0.015 


0.985 


0.037 


1 




25 


0.047 


1 


0.062 


1 


0.015 


0.397 


0.043 


1 




11 


0.041 


1 


0.096 


1 


0.018 


1 


0.057 


1 


0.55 


16 


0.045 


1 


0.066 


1 


0.017 


1 


0.046 


1 


21 


0.065 


1 


0.06 


1 


0.034 


1 


0.034 


1 




25 


0.045 


1 


0.051 


1 


0.024 


1 


0.032 


1 
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Table 3: Ho : AR{1), Ha : ARCH{1) T = 500 



T = 


500 




a — 


0.1 






a — 


0.05 




Bootstrap 


Normal 


Bootstrap 


Normal 


a 


M 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 




14 




1 


n 0Q8 


1 


024 


1 


063 


1 

X 


0.3 


21 


064 


1 


082 


1 


023 


1 


052 


1 


28 


06 

\J . \J\J 


1 


0Q3 


1 


024 


1 


062 

\j . \j\J ^ 


1 




35 


0.07 


1 


0.086 


1 


0.033 


1 


0.062 


1 




14 


043 


1 




1 

± 


n 01 4 


1 

± 


064 


1 

X 


0.4 


21 


058 


1 


092 


1 


01 5 


1 


056 


1 


28 


066 


1 


094 


1 


03 


1 


061 

\J . \J\J X 


1 




35 


0.073 


1 


0.087 


1 


0.032 


1 


0.052 


1 




14 


0.031 


1 


0.105 


1 


0.018 


1 


0.072 


1 


0.5 


21 


0.059 


1 


0.079 


1 


0.03 


1 


0.05 


1 


28 


0.076 


1 


0.111 


1 


0.046 


1 


0.069 


1 




35 


0.053 


1 


0.086 


1 


0.022 


1 


0.055 


1 




14 


0.038 


1 


0.107 


1 


0.014 


1 


0.077 


1 


0.55 


21 


0.056 


1 


0.108 


1 


0.021 


1 


0.067 


1 


28 


0.071 


1 


0.103 


1 


0.032 


1 


0.06 


1 




35 


0.051 


1 


0.089 


1 


0.026 


1 


0.06 


1 



Table 4: //q : Ai?Ci/(l), iJ^ = AR{1) T = 100 



T = 


100 




a = 


0.1 






a = 


0.05 




Bootstrap 


Normal 


Bootstrap 


Normal 


a 


M 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 




11 


0.039 


0.994 


0.08 


0.997 


0.022 


0.984 


0.051 


0.995 


0.3 


16 


0.043 


0.978 


0.086 


0.991 


0.009 


0.925 


0.055 


0.983 


21 


0.045 


0.98 


0.07 


0.99 


0.016 


0.934 


0.051 


0.983 




25 


0.026 


0.939 


0.059 


0.976 


0.011 


0.895 


0.045 


0.965 




11 


0.046 


1 


0.086 


1 


0.012 


0.999 


0.053 


1 


0.4 


16 


0.049 


0.993 


0.092 


0.999 


0.014 


0.988 


0.062 


0.996 


21 


0.03 


0.994 


0.07 


0.997 


0.017 


0.983 


0.046 


0.997 




25 


0.038 


0.994 


0.083 


0.997 


0.024 


0.982 


0.059 


0.994 




11 


0.054 


1 


0.107 


1 


0.024 


1 


0.067 


1 


0.5 


16 


0.063 


1 


0.098 


1 


0.03 


1 


0.066 


1 


21 


0.051 


1 


0.083 


1 


0.022 


1 


0.061 


1 




25 


0.028 


0.997 


0.06 


0.998 


0.012 


0.995 


0.043 


0.998 




11 


0.074 


1 


0.113 


1 


0.03 


1 


0.081 


1 


0.55 


16 


0.056 


1 


0.087 


1 


0.02 


1 


0.054 


1 


21 


0.065 


1 


0.08 


1 


0.038 


1 


0.057 


1 




25 


0.067 


1 


0.088 


1 


0.03 


1 


0.065 


1 
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Table 5: Ho : ARCH{1) and Ha : AR{1) T = 500 



T = 


500 




a = 


0.1 






a = 


0.05 




Bootstrap 


Normal 


Bootstrap 


Normal 


a 


U 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 


Ho 


Ha 




14 


0.072 


1 


0.09 


1 


0.025 


1 


0.059 


1 


0.3 


21 


0.062 


1 


0.094 


1 


0.032 


1 


0.059 


1 


28 


0.067 


1 


0.097 


1 


0.024 


1 


0.062 


1 




35 


0.076 


1 


0.101 


1 


0.026 


1 


0.073 


1 




14 


0.045 


1 


0.097 


1 


0.022 


1 


0.059 


1 


0.4 


21 


0.075 


1 


0.105 


1 


0.03 


1 


0.077 


1 


28 


0.06 


1 


0.111 


1 


0.024 


1 


0.07 


1 




35 


0.085 


1 


0.12 


1 


0.041 


1 


0.086 


1 




14 


0.053 


1 


0.129 


1 


0.032 


1 


0.079 


1 


0.5 


21 


0.1 


1 


0.121 


1 


0.054 


1 


0.082 


1 


28 


0.111 


1 


0.124 


1 


0.071 


1 


0.085 


1 




35 


0.066 


1 


0.117 


1 


0.029 


1 


0.075 


1 




14 


0.099 


1 


0.143 


1 


0.047 


1 


0.104 


1 


0.55 


21 


0.074 


1 


0.119 


1 


0.042 


1 


0.083 


1 


28 


0.078 


1 


0.11 


1 


0.037 


1 


0.072 


1 




35 


0.082 


1 


0.119 


1 


0.037 


1 


0.085 


1 
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